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Abstract 

For an n x n symmetric positive definite matrix T = (Uj) with positive 
elements satisfying t iti > ^ J an< ^ cer t am bounding conditions, we pro- 
pose to use the matrix S = (sij) to approximate its inverse, where Sjj = 
$i,j/ti,i — l/t.., Si,j is the Kronecker delta function, and i . = Ylij=iO-~^ij)^iJ- 
An explicit bound on the approximation error is obtained, showing that the 
inverse is well approximated to order l/(n — l) 2 uniformly. The results are 
further extended to allow some off-diagonal elements of T to be zeros. 

Keywords: Approximation error; Inverse; Symmetric; Non-negative 
elements. 



1. Introduction 

When solving the solution for a large system of linear equations, a good 
approximate inverse of the coefficient matrix is crucially important in es- 
tablishing fast convergence rates for iterative algorithms. See the extensive 
reviews: , Esf. Here, we are concerned with nxn symmetric diagonally 

dominant matrices T = (Uj) with positive elements, i.e., 



n 



ho = > and hi ^ 2^ *»,j> i = 1, - ■ ■ ,n. (1) 
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This kind of diagonally dominant nonnegative matrices has received wide 
attention 0, 0, |l0[. It is easy to show that T must be positive definite. The 
problems on inverses of nonnegative matrices have been extensively discussed 
0, 0]- Markham 11] and Martinez, Michon and San Martin 12] studied 
the sufficient conditions that the inverse of a nonnegative matrix is an M- 
matrix. 

In this paper, we propose to approximate the inverse of T, T _1 , by the 



matrix S 



where 



J l,3 



u 



t 



where t. . = 5Z" 3 - = i(l — An explicit upper bound on the approximation 

error is given in the following section, which is crucially used to establish the 
asymptotical normality of an estimated vector and a Wilks type of theorem 
in the 0- mo del for undirected random graphs with a diverging number of 
nodes [la, LLj 



2. An explicit bound on the approximation error 

Let m := min tj,-, Aj := ta— ^j^Uj, M := max{ max max Aj}, 

l<i<j<n ' ■'' ' l<*<i<" ' l<i<n 

and for a matrix A = (ajj), define ||A|| := max^j \a^j\. We have the following 
theorem. 

Theorem 1. 



in - i; 



where 



= n(M/m) + (n-2) (n - 2)M/m M 3M 1 

1 ' J 1 2(n-2) ((n-2) +M/m)((n-2) + 2M/m) J m 2 m 2 n J 2m' 



Proof. Let I n be the n x n identity matrix. Define F = T 1 — S , V = 
(vij) = I n — TS and W = (wij) = SV . We have the recursion 

F = T~ 1 -S = (T^ 1 - S){I n - TS) + S(I n - TS) = FV + W. (2) 



2 



Note that 



= kj ~ 


fe=i 


= kj ~ 


k=i z ™ 






\\^3 _|_ l 


= (kj - 



A* 



(3) 



and 

n n 6- 1 t 

k=i k=\ c m ■■ c w ■■ 

tM(^j - 1)t^ + —^7 ] -i~2^[(hj - 1)t^ + — ^ 

fc=i *'* •• ■■ fc=i *• 

- [ t M v M .. J t . [ tjJ +2+ J 



(4) 



Furthermore, when i ^ j , 



1 

< - < 



i.. mn(n — 1) 



< — < 

U,itj,j m 2 {n-l) 

At M 
< — - < 



2 ' 



U,it.. m 2 n{n — l) 2 ' 
and it is easy to show, when i,j, k are different from each other, 

1 3M 

Fm < max l 7 7W' 

mn[n — 1J m z n[n — l) z 

1 M 3M 

Fi,i — m ax{ 7 7T 5 57 777 H 5 7 TT?/' 
mn[n — 1) m z [n — \y m z n(n — l) z 



M M 
m 2 (n — l) 2 m 2 n(n — l) 5 

M M 

F»)» — 57 7T9 ^ 9 7 TT5"' 

rrr(n — iy m z n{n — l) z 
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It follows that 

M 3M 
m 2 (n — l) 2 m 2 n(n — 1) 



max(\w i:j \, \w id - w itk \) < ~^TZ ~ + H^TTI ~ f or al1 h3i ( 5 ) 



iVeztf we use the recursion ((2]) to obtain a bound of the approximate error 
\\F\\. Let a = m2( f_ 1)2 + m2r fff_ 1)2 ■ By P) and p, /or any i, we nave 

n j- 2t — A 

Ai = ^ fi,k[( s k,j ~ — ~ t -)]+ w hj, j = l,---,n. (6) 

fe=i M 

Thus, to prove Theorem 1, it is sufficient to show that \ fij\ < C(M,m)/(n — 
l) 2 for any Fixing any i, let f ia = max f ik and ftp = min f ik . 

l<k<n l<k<n 

Without loss of generality, we assume that /j jQ! > \fi t p\. 

First, we will show that fi t p < l/t„ < l/(m(n— l) 2 ). A direct calculation 
gives that 

n n 5 \ 

^ fi,kh,i = ^(Ti^k - (j- - 
fc=l k=l l ' 1 

n n 

= i-(i-£f) = £f- m 

fc=i ■■ A,-=i •• 

Thus, $X=i *fc,i - Y2=ihMk,k = ELiT^- It follows that fa < 1/t. 
and, similarly, f^ a > 

iVoto f/iat (1 - A a /t a ,a)fi,p = - ELi -M4, Q - 1)^- 27ms, 

n j, V^/p /• wr i\^c,a , „ r ^tk,k — Afc - 



/i,a + (l-— -)/i,/9 = 5^(^' fc_ A/3)(^,a-l)T^ + ^/i,fc[— ~ -)}+Wi,a- 

k=l a ' a k=l 

(8) 



Similarly, we have that 

k,+a-p^)k, = a» - - 1) ^ + e a*[ 2tfc,fc r Afc )] + 

(9) 

Combining the above two equations, it yields 

fi,a-fi,p = ^{fi,k~ fi,p)[{5k, a -^) t ^-{h,p-l) t ^]+Wi^-W i j 3 . (10) 

£a,a t/3,/3 



fc=l 



Let O = {k : (1 - 6 k ,p)t k> p/tp t p > (1 - and /et |Q| = A. iVofe 

£/iai 1 < A < n — 1 . Then, 



E(a*-/^)[(**.«- 1)^-^-1)^] 



< (/t,a — /i,/3)[ 



tp,p t 



a, a 



< (f _ f u XM (A — l)m 

" Ut ' Q /4,/3j[ AM + (n-l-A)m (A — l)m + (n — A)M + M 

Let 

AM (A-l)m 



XM+(n-l-X)m (A - l)m+ (n - A)M' 
There are two cases to consider the maximum of /(A) m £/ie range of A G 

[1,71-1]. 

Case /; When M = m, it is easy to show /(A) = l/(n — 1). 
Case 77: M ^ m. Since 

(n-l)Mm (n-l)Im 

/ ( A ) - 



[AM + (n — 1 — A)m] 2 [(A - l)m + (n — A)M] 2 
(n - l)Mm[(n - 2A)(M - m)][AM + (n - 1 - A)m + (A - l)m + (n - A)M] 
[AM + (n - 1 - A)m.] 2 [(A - l)m + (n - \)M] 2 

and 

/"(A) = -2(M-m)Mm(ii-l) ( — — — + 



[AM + (n - 1 - A)m] 3 [(A - l)m + (n — A)M] J 

/(A) ta£;es z£s maximum at A = n/2 tynen 1 < A < n — 1. ^4 direct calculation 
gives that 

n nM -{n- 2)m 

J V nM+(n-2)m' 1 J 

Moreover, let 

(A — l)m (A — l)m 



<?(A) 



(A - l)m +(n- \)M (A - l)m + (n - \)M + M' 
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Since 

_ Mm[M 2 ((n - A) 2 + 2(n - A) (A - 1) + n - 1) + (2Mm - m 2 )(A - l) 2 ] 
9 ^' ~ [(A - l)m + (n - A)M] 2 [(A - l)m + (n - A)M + M] 2 ' 

^'(A) > u>/ien 1 < A < n — 1 such that for 1 < A < n — 1, 

(n-2)Mm 

' ~ [(n - 2)m + M][(n - 2)m + 2M] ' ^ ^ 



£y (Jl2]) and dnj, we have 

AM (A-l)m 



max 



i<A<n-i L AM + (rc - 1 - \)m (A - l)m + (n - A)M + M J 

< max /(A) + max a(A) 

l<A<n— 1 l<A<n— 1 

2 T/W . nM-(n-2)m T/w . . (n-2)Mm 

< -I(M = m) + — — — ^ m) + 



n v y nM + (n - 2)m [(n - 2)m + M] [(n - 2)m + 2M] 

nM - (n - 2)m (n - 2)Mm 



?iM+(ii - 2)m [(n - 2)m + M] [(n - 2)m + 2M] ' 
where !(■) is an indictor function. Combining (fTTj) and (JUJ), it yields 



(14) 



VnM + 


(n — 2)m ' [(n 


- 2)m + M] [(n - 2)m + 2M] 


nM + 


[n — 2)m 


(n - 2)Mm 


[ 2(n 


— 2)m [(n - 


- 2)m + M] [(n - 2)m + 2M] ^ 


nM + 


(n — 2)m 


(n - 2)Mm 


[ 2(n 


— 2)m [(n 


- 2)m + M] [(n - 2)m + 2M] ■ 



fi, a - h,p < [ z^tttz — t^z: + ytz — , vfutz — , ) x (A* ~ A/?) + a ' 

so i/iai 

nM 4- (n. — 9><m (n —0\ Mm 

-} x a. 

zijt — z ym yyn — z ^nt -|- iw j [^n — z jnt -|- zjw 

Consequent/?/, 



M 3M 

X Hr7 TTo + 



m 2 (n — l) 2 m 2 n(n — l) 2 2m(n — l) 2 
C(M,m)/(n- l) 2 . 



TTizs completes the proof. 
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Now we extend the results to allow some off-diagonal elements of T 
to be zeros. In this case, we redefine m = mm^j^ e ^ij). tij> oyti t j. More- 
over, define n, = Y%=i ; j& I fad > °) anci Pmax = max, in/ (n - 1) and 
p min = mmiUi/^n - 1). 



Condition A: Assume that 



T 



\ 



rp{rn) 



where T^' k . is a sub-matrix consisting of all positive elements, for every 
% = 1 , • • • , m, and min (hi — 2) jn > r . 

i=l,'" ,m 

Then under Condition A, we have the following theorem. 

Theorem 2. Assume X]j=i(^J — -Q^»J = / or a ^ Under Condition A, if 
r > 0, then 

| jT" 1 < C ^ m ' M ' Pmax ' Pmin ' ^ 



n-V 



where 



n( , 4M 2 pmax(p max - r/2) 4p max M M 1 
C(m,M, p max , Pmin, r ) = ( — + )x(— H 



m?T 2 



mr 



p 2 min m 2 2p min m 



Proof, I??/ i/ie assumption X)j=i(^»,j ~~ = / or a ^ ^ ^ ^ fl,ue 
Afc = and 2tfc,/t = X/d=i suc ^ 



2 fi,ktk,k — Y^ /i,fe£fc,< 



fc=i 



fe=l d=l 
n n 



Y Y T i,k lt kA - Y Y 



k=l d=l 



d=l k=l 
tid 2tdd, 



d=i 
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This shows 

~ t 



—^ = T - (15) 



fc=i 

In view of (jHJ) and (|T5|) . yields 



fi,a = ^ fi,k(5k,a - 1)^- + Wi ;Q + (16) 
fc=l 



Similar to the inequality (jSJ) , u>/ien some entries of T are zero, we have 
the following bound for max{\wij\, \ wij — iWj,fc|}-' 

M 

max( iWij , «)y - w ik \) < —r for all k. (17) 

m 2 p 2 min (n-l) 2 

Define fi jCt and f^p as in the proof of Theorem 2.1 and fix i. Similarly, the 
equation (J7|) holds and f^p < l/(2i.) < 1 / (2mp 2 nin (n — l) 2 ). Without loss of 
generality, we assume that /j )Q > \fi,p\. 

Let b = {M/m 2 + l/(2mj)/(p 2 min (n - l) 2 ). Then \w id + l/(2t .)| < b for 
all Assume that t a>a G T k k . ; where T k k . is a set consisting of all the 
elements ofT^' k ,. IfYl}=ih < a < YH=i^i> then define Vt = {Y^iZih + 

1, • • • , Ym=i ki}\{ a }i otherwise, define Q = {X^=i h + • • ■ , J2]=i ^i}- Note 
that for any j, I G Q, tjj > 0. Moreover, let Qi = {k : f i k > 0, k G Q} and 
n 2 = {k : f i:k < 0, k G SI}. Then |^i| + \Q 2 \ = \Q\ > rn + 2. Thus, at 
least one of and IQ2I is no less than |0|/2. T/ius, we consider two cases 
separately. 

Case I: > |fi|/2 > rn/2 + 1. Let = min ieni > 0. % (fT6|), 

& > + Ak)(i - s k , a )^ > (f ha + fi, ai ) m{m ~ 1] - (18) 

fc—l "a,a n a lVl 

It follows that 

f < f f < ZPmexMb 

Ji,a — Ji.a ~r Ji.ax — 

mr 

Case JJ: > 1^1/2 > rn + 1. Lei /j jQ2 = minj G n 2 /jj < 0. Similar to (1181) . 
we nave 

6 > J^(/i,a + /i,fc)(l - 4,a)^ > (/i, a + fi,a2 ) ~~~ ~~~/Tf ~ ' 

^«,a n a ivi 



and ^ 

fi,a fi,a2 — ■ (^) 

171T 

By §6§ and ([7]), we have 

j^(/i,a 2 + Afe)(! - ^aj^ 2 - = ^i,a 2 + > -b, 



k=i 



so that 



-b < jrtfi^+hk^-h,^ 



k=l 



t 



— ^ ^ (fi,02 f 1,013) , ~t~ ^ ^ (fi,a2 fi,k), 

— \J 1,02 ~r Ji,a-i) , # T~ \Ji : ct2 ~r Ji,aJ ) 



.tt 2 



]Vfn a 2 

where Q 3 = {j : t a2>j > 0;j 7^ a 2 } and f i>a3 = max j6fi2 n q 3 < 0. iVote 
i/iai «2 G ^2 ^ ^- From Condition A, we know that Q 2 f]^3 — r ( n — -0/2 

_ (/ . , +/ . j Minsrw 

Mn a2 mn a2 



or equivalently, 

H&TIC& 

_,, f , 2Affrp max 4M 2 p max (p max - r/2)6 

i?y (TI9)) . we /iave 

, < _f , 2 Pm^Mb 

Ji,a — Ji,a2 ' 

mr 

< -(/,,« +/,,„)+ 2 ^^ 

mr 

4M 2 pmax(Pmax - r/2)6 , 4p max M6 



m 2 r 2 mr 



27ms completes the proof. 
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3. Discussion 



The matrix S which we use to approximate the inverse of the matrix T 
takes the form of / + H r , where each element of H c is c. If c > 0, then S is a 



class of preconditioners for M-matrices [18j • In our situation, c < since S is 
a matrix with non-negative elements. The bound on the approximation error 
in Theorem 1 depends on m, M and n. When m and M are bounded by a 
constant, all the elements of T" 1 — S are of order 0(1/ (n — l) 2 ) as n — > oo, 
uniformly. Therefore we conjecture that T may be inverse M-matrices. The 
interested readers can refer to jjj, 13 . 



When proving the asymptotic normality of the maximum likelihood esti 



mate in the /3-model with a diverging dimension n, Yan, Xu and Yang [16 
need to consider the approximation inverse of a Fisher information matrix 
satisfying the conditions (pQ) due to that it doesn't has an explicit expression 
but some special cases, and use S as its workable substitute. Theorem [2] is 
used to a situation with sparse statistical experiments for the /3-model in our 
future work. Moreover, in a work on strict diagonally dominant M-matrices 



with certain bounded conditions, Simons and Yao [14( derived their good 
approximated inverses and proved the approximated errors are order 1/n 2 as 
well, which is crucial in proving that the maximum likelihood estimate in the 



Bradley- Terry model is asymptotical normality with a large dimension [15 

Finally, we illustrate by an example that the bound on the approximation 
error in Theorem 2.1 is optimal in the sense that any bound in the form of 
C(m, M)f f(n) requires f(n) = 0((n — l) 2 ) as n — > oo. Assume that the 
matrix T consists of the elements: t\ } \ = (n — l)M;t\j = tj } \ = M,j = 
2, • • • ,n and t M = (n - l)m,i = 2, • • • ,n;t itj = m, i, j = 2, ■ ■ ■ , n; i ^ j, 
which satisfies ([T]). By the Sherman- Morrison formula, we have 



(n-2)M 2(n - l)(n - 2)M' 
(T " 1)i ' 1 = "2(n-l)(n-2)M' 2 = 2 '"--' n ' 



and for i > j > 2, 



(n — 2)m 2(n — l)(n — 2)m 
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In this case, the elements of S are 



Si, 





ki 




1 




(n 


- l)M 


(n - 


1)(M + 


(n — l)m) 




kj 




1 




(n 


— l)m 


(n — 


l)(M+i 


[n — l)m) 




ki 




1 




(n 


— l)m 


(n — 


l)(M+i 


'n — l)m) 



1 

Si i ~ " s ~ 7T7TT ' ~ T i ^ 2 , , Ti , 

= /„ "'^„ ~ 71 T\7T7~, 7Z TvITV' hJ = 1 ,'-- ,ri;iy£ j. 

It is easy to show that the bound of | |T _1 — S\ | is 0( ( - n _ 1 1 p m2 ). This suggests 
that the rate 1 / (n — l) 2 is optimal. On the other hand, there is a gap between 
1/m 2 and C(m,M) = 0(M 2 /m 3 ) which implies that there might be space 
for improvement. It is interesting to see if the bounds in Theorem 2.1 can 
be further relaxed as well as in Theorem 2.2. 
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